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ABSTRACT 

Let X,Xi,X2, ... be a sequence of non-degenerate i.i.d. random 
variables with mean zero. The best possible weighted approxi- 
^ ', mations are investigated in D[0, 1] for the partial sum processes 

(X) ! {S[nt], < t < 1}, where Sn = Z]j=i ^j, under the assumption that 

^ I X belongs to the domain of attraction of the normal law. The con- 

clusions then are used to establish similar results for the sequence of 
self-normalized partial sum processes {S[nt]/Vn,0 < t < 1}, where 
t^^ ', V^ = J2]'=i^j- Lp approximations of self-normalized partial sum 

^^ ' processes are also discussed. 
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sup 

0<«1 



Op(l) if and only if Var(X) = a < oo. 



1 Introduction and main results 

Let X, Xi,X2,... be a sequence of non-degenerate i.i.d. random variables with EX = 
and let Sn = Yll'=iXj, n > 1, denote their partial sums. The classical weak invariance 
principle in probability states that, on an appropriate probability space for {Sn, ^ > 1} and 
a standard Wiener process {W{t), < t < oo}, as n ^ oo, we have 

S[nt] Wjnt) 
Vncr ^/n 

This invariance principle in probability implies the following version of Donsker's classical 
Functional Central Limit Theorem on {D,V, \\ ||), where V is the a-field of subsets of -D = 
D[0, 1] generated by its finite-dimensional subsets, and || || stands for the sup-norm metric 
on D. 

Corollary A With — >ii standing for convergence in distribution as n ^ oo, we have 

h{Sin.]/V^6)^dh{W{-)) 

for all h : D = D[0,1] -^ M that are {D,V) measurable and \\ \\- continuous, or \\ \\- 
continuous except at points forming a set of Wiener measure zero on {D,V), where W{-) 
stands for a standard Wiener process on the unit interval [0, 1]. 

Remark A For further reference the statement of Corollary A is summarized by writing, 

as n ^ oo, 

S[nt]/V^6 ^ Wit) on {D,V,\\ II). 

For details and further thoughts on Donsker's theorem via (1) as in Corollary A, we refer 
to Breiman (1968, Sections 13.4-13.5), Csorgo and Revesz (1981, Section 2.1), and Csorgo 
(2002, Sections 3.3-3.4). 

In view of (1), it is natural to seek conditions for having the following weighted approxi- 
mation on an appropriate probability space for S'„, n > 1, and W{-): 

S[nt] Wjnt) 

where q{t) is a non-negative function on (0, 1] approaching zero as t | 0. In this direction, 
using the methods developed by Csorgo, Csorgo, Horvath and Mason [CsCsHM] (1986), and 
subsequently by Csorgo and Horvath (1986), for weighted empirical and quantile processes, 
based on the Komlos, Major and Tusnady [KMT] (1975, 1976) and Major (1976) strong 
approximations for partial sum processes, Csorgo and Horvath (1988) concluded that, on an 
appropriate probability space, as n — > oo. 



sup 

0<t<l 



/q{t) = Op(l), n^oo, (2) 



sup : 

l/n<t<l 



S[nt] Wjnt) 



tV2-M = Op{l), (3) 



for any < /i < 1/2 — 1/r, if we assume ii^|X|'' < oo for some r > 2. 

Let Q be the class of positive functions q{t) on (0, 1], i.e., inf5<t<i q{t) > for < 5 < 1, 
which are nondecreasing near zero, and let 

/(g, c) = t~^ exp (-cq^{t)/t\ dt, < c < oo. 

By virtue of the result (3), we have the following fact: if i?|X|^ < oo for some r > 2 and 
q E Q such that I{q, c) < oo for all c > 0, then the claim (2) holds true. We note in passing 
that the class of weight functions q & Q such that I{q, c) < oo for all c > is the optimal 
class for having (2) (cf. CsCsHM (1986) via Lemma 3 here). For more details along these 
lines, we refer to Szyszkowicz (1991, 1992, 1996, 1997) where, by a different method, the 
statement of (2) is established, again for the optimal class of weight functions, assuming only 
the existence of two moments. 

In this paper, we establish a result which is similar to (2) only under the assumption that 
X belongs to the domain of attraction of the normal law, written X G DAN throughout. In 
fact, it is well-known that X G DAN with EX = if and only if there exists a sequence of 
constants (i„ t oo such that, as n ^ oo, Sn/dn — >d N{0, 1). It is natural to ask whether 
a similar version of the weighted approximation (2) could also hold true. Throughout the 
paper, we make use of the notation l{x) = EX^Iqx\<x), 6 = inf {x > 1 : l{x) > 0}, 



inf{s:s>6 + l,^<i} 



r^, = inf |s : s > 6 + 1,^ < -|, j = 1,2,.... 

and 6^ = nl{rin). We have the following theorem which provides an affirmative answer to 
this paramount question (cf. Corollary 1). 

Theorem 1 Let q E Q and assume that X G DAN and EX = 0. Then, on an appropriate 
probability space for X,Xi,X2,- ■■ , a standard Wiener process {W(t),0 <t< oo} can be 
constructed in such a way that the following statements hold true as n —^ oo: 

(a) If I{q, c) < oo for all c> 0, then 



sup 

l/n<t<l 



Sint]/bn-W{nt)/V^\/q{t) = op(l). (4) 



(b) If I{q, c) < oo for some c> 0, then 



sup 

l/n<t<l 



S^nt]/hn-W{nt)/^ /q{t) = Op(l). (5) 



(c) If I{q,c) < oo for some c > 0, then there exists a sequence of constants r„ ^ such 
that 



sup 

Tn<t<l 



S[nt]/bn-Wint)/y/^\/q{t) = Op{l) 



(6) 



Remark 1. If EX^ < oo, then r„ in (6) can be changed to 1/n. In this case, it is 
readily seen that na"^ /h\ — > 1, as n ^ oo. Hence, via Theorem 1.1 of Szyszkowicz (1997), a 
standard Wiener process {W{t), < t < oo} can be constructed such that 



sup 

l/n<t<l 



Synt]/hn~W{nt)/^\/q{t) 

S[nt]/V^<y - Wint)/^ /q{t) 



bn l/n<t<l 

\fno 



+ 

Op(l), 



- 1 



sup 

0<t<l 



rr^l'^W{nt) /q{t) 



where we make use of supo<j<i n ^''^W{nt) / q{t) = Op(l), which follows from Lemma 3 
below via having the equality in distribution 

{n-^/^Wint)/q{t), < t < l} =d {w^(t)/g(t), < t < l} 

for each n > 1. However, it is impossible to replace r„ in (6) by 1/n without further 
restrictions on X and/or q & Q. In Section 2, an example will be given [cf. Proof of (7)] to 
show that (6) holds in terms of a standard Wiener process {W{t), < t < oo}, but 



sup 

l/n<t<l 



S[nt]/bn - W{nt)/^ /q{t) ^ Op(l 



(7) 



with g^(t) = tloglog(t ^), where logx = log(max{e,x}) here, as well as throughout. 

The following corollaries are consequences of Theorem 1, and are of independent interest. 

Corollary 1 Let q E Q. As n ^ oo, the following statements are equivalent: 
(a) X e DAN and EX = 0; 

Sint]/bn =^ W(t) on {D,V,\\ /q\\) if and only if I{q,c) < oo for all c > 0, where 
{W{t), < t < 1} is a standard Wiener process and || /q\\ is the weighted sup-norm 
metric for functions x, y in D[0, 1], defined by 

\\{x-y)/q\\= sup |(x(t)-y(t))/g(t)| (8) 

0<t<l 



whenever this is well defined, i.e., when hmsup^^o \i.^{^) ^ ^(^))/Q'(^)I ^"^ finite; 



(c) On the probability space of Theorem 1 for X, Xi,X2, . . ., a standard Wiener process 
{W^(t),0<t<oo} can be constructed in such a way that, as n -^ oo, 

sup \S^nt]lhn - W{nt)ln^/^\lq{t) = op(l) (9) 

0<t<l 

if and only if I{q, c) < oo for all c> 0. 

Mutatis mutandis, (b) above is to be read d la Corollary A and Remark A. 

While Corollary 1 is a direct consequence of Theorem 1, we now state convergence in 
distribution results for sup-functionals of weighted normalized partial sums for the optimal 
class of weight functions q E Q satisfying limsup^j^o l^(^)l/?(^) < ^^ '^■^- (see (b) of Lemma 
3). Consequently, the results that follow are not implied by Corollary 1 above, and they 
cannot be obtained via classical methods of weak convergence either, for tightness in our 
weighted sup-norm is not guaranteed by (b) of Lemma 3. 

Corollary 2 Let {W{t), <t < oo} be a standard Wiener process, X E DAN and EX = 0. 

(a) Ifq G Q, then there exists a sequence of positive constants r„ ^ such that, asn ^ oo, 

h-^ sup \Sy,4/q{t) ^, sup \W{t)\/q{t) (10) 

Tn<t<l 0<t<l 

if and only if I{q, c) < oo for some c > 0. 

(b) If q E Q and q{t) is nondecreasing on (0, 1], then, as n ^ oo, 

6;i sup \Sint]\/q{t) ^d sup \W{t)\/q{t) (11) 

0<t<l 0<t<l 

if and only if I{q, c) < oo for some c > 0. Consequently, as n ^ oo, we have 
b~' sup |5[„,]|/(tloglog(t-i))^/2 ^, sup |W^(t)|/(tloglog(t-i))^/^ 

0<t<l 0<t<l 

Remark 2. Corollary 2 rhymes with Corollary 1.1 of Szyszkowicz (1997), where X is 
assumed to have two moments. It remains an open problem whether sup^^<j<]^ in (10) can 
be improved to supo<f<i without further restrictions on X and/or q E Q. 

Remark 3. The main results of Corollary 1 were announced without proofs in Csorgo, 
Szyszkowicz and Wang [CsSzW] (2004), where we reviewed weighted approximations and 
strong limit theorems for self-normalized partial sum processes. It is interesting and also of 
interest to note that the class of the weight functions in Corollary 2 is bigger than that in 



Corollary 1. Such a phenomenon was first noticed and proved for weighted empirical and 
quantile processes by CsCsHM (1986) and then by Csorgo and Horvath (1988) for partial 
sums on assuming i?|X|^ < oo for some v > 2. For more details along these lines, we refer 
to Szyszkowicz (1991, 1996, 1997), and to Csorgo, Norvaisa and Szyszkowicz [CsNSz](1999). 

We next consider applications of Theorem 1 to the so-called self-normalized partial sum 
processes defined by {5'[„(]/\4, < t < oo}, where V^ = Yl]=i ^j- Note that 

V^/bl ^p 1 (12) 

if X G DAN (see the result (18) in CsSzW (2003), for example). This, together with 
Theorem 1, yields the following Theorem 2. We mention that Theorem 2 and its corollaries 
were announced without proofs in CsSzW (2004). We restate them here for convenient 
reference and further use in the sequel. 

Theorem 2 Assume that X G DAN and EX = 0. Then, on the probability space o/ Theo- 
rem 1 for X,Xi,X2,- ■ ■ , the there constructed standard Wiener process {W{t),0 < t < cxd} 
is such that that the following statements hold true. 



(a) Let q E Q. Then, as n ^ oo, 

sup S[nt]/Vn-W{nt)/^/n /q{t) 

l/n<t<l ' 

^ f Op(l) if I {q,c) <oo for alio 0, ,_^^. 

1 Op{l) if I {q,c) < oo for some c> 0. ^ ' 

(b) Let q E Q and I{q, c) < oo for some c > 0. Then there exists a sequence of constants 
Tn ^ such that as n ^ oo, 



sup 

r„<t<l 



S[nt]lVn - W{nt)l^ Iqit) = op(l). (14) 



Corollary 3 Let q E Q. As n ^ oo, the following statements are equivalent: 

(a) X G DAN and EX = 0; 

(b) S[nt]/yn =^d W{t) on {D,V, II /g||) if and only ifl{q,c) < oo for alia > 0, where \\ /q\\ 
is defined as in Corollary 1 and {W{t), < t < 1} is a standard Wiener process; 

(c) On the probability space of Theorem 1 for X, Xi,X2, . . ., a standard Wiener process 
{W^(t),0<t<oo} can be constructed in such a way that, as n ^ oo, 

sup \S[nt]/Vn - W{nt)/n'/^\/q{t) = op(l) (15) 

0<t<l 

if and only if I{q, c) < oo for all c> 0. 



Corollary 4 The conclusions of Corollary 2 continue to hold true if we replace the normal- 
izing constants hn by Vn- 

Remark 4. With g = 1, Corollary 3 reduces to Theorem 1 of CsSzW (2003), an in 
probability version of Donsker's theorem for self-normalized partial sum processes. Corol- 
laries 3 and 4 provide basic tools for investigating the limit behavior of statistics that arise 
in studying the problem of a change in the mean in the domain of attraction of the normal 
law. For details we refer to Section 5 in CsSzW (2004). 

For the sake of Studentized versions of Theorem 2, Corollaries 3 and 4, consider now the 
sequence T„((.) of Student processes in t G [0, 1] on D[0, 1], defined as 

{T„,(X),0<t<l} := { , (Vv^)^»=i-^- , 0<t<l| 

^-i ^-/^" 0<t<ll. 



[n-{SjVnf]/{n-l) 



Clearly, T„^i(X) is the familiar form of the classical Student ratio. When X =d iV(/i, o"^), 
then T„ i(X — /i) is his famous t-random variable with n — 1 degrees of freedom [cf. "Student" 
(1908)]. Clearly, if T„^i(X) or Sn/Vn has an asymptotic distribution, then so does the other, 
and it is well known that they coincide (cf., e.g.. Proposition 1 in Griffin (2002)). Hence, 
usually, and without loss of generality, the limiting distribution of Sn/Vn is studied in lieu of 
that of Tn,i{X). In fact via Theorem 2 and Corollaries 3 and 4 we follow a functional version 
of this route. Backtracking a bit, Logan, Mallows, Rice and Shepp (1973) conjectured that 
"5'n/Ki is asymptotically normal if (and perhaps only if) X is in the domain of attraction of 
the normal law". It is the "only if part that has remained open until 1997 for the general 
case of not necessarily symmetric random variables, when Cine, Gotze and Mason (1997) 
proved the following result. 

Theorem A. The following two statements are equivalent: 
(i) X is in the domain of attraction of the normal law; 
(ii) There exists a finite constant fi such that, as n ^ oo, Tn,i{X — /i) ^d A^(0, 1). 

Moreover, if either (i) or (ii) holds, then fi = EX . 

Furthermore, Chistyakov and Gotze (2004) confirmed a second conjecture of Logan et 
al. (1973) that the Student t-statistic has a non-trivial limiting distribution if and only if 
X is in the domain of attraction of a stable law with some exponent a G (0,2]. Our next 
corollary constitutes a Studentized version of the self- normalized results of Theorem 2, and 
Corollaries 3 and 4. Thus it amounts to various optimal functional extensions of Theorem 
Am{D,V,\\/q\\). 

6 



Corollary 5 The results (a), (b) 0/ Theorem 2 continue to hold true when EX = fi, with 
Tn^t{X — fi) replacing S[nt]/Vn in each of the two statements. Mutatis mutandis, the same is 
true as well in case 0/ Corollaries 3 and 4. 

This paper is organized as follows. In Section 2 we provide proofs of the main results. 
The proof of Proposition 1, which is used in the proofs of main results, will be given in 
Section 3. Finally, in Section 4 we will discuss weighted approximations of self- normalized 
partial sum processes under the optimal class of weight functions in Lp. Throughout the 
paper, A,Ai,A2, ... denote constants which may be different at each appearance. 

In concluding this section, we mention some of the previous results on weighted ap- 
proximation. The study of weighted approximations originates from the earlier works of 
Anderson and Darling (1952), Renyi (1953), Chibisov (1964), Pyke and Shorack (1968) 
and O'Reilly (1974), who investigated the asymptotic behaviour of weighted empirical and 
quantile processes. The works of these authors were later extented by CsCsHM (1986), 
Szyszkowicz (1991, 1992, 1996, 1997) and CsNSz (1999). In CsCsHM (1986), the authors 
established approximations of empirical and quantile processes by sequences of Brownian 
bridges in weighted supremum metrics for the optimal class of weight functions. Szyszkow- 
icz (1996, 1997) derived similarly optimal weighted approximations of standardized par- 
tial sum processes in D[0,oo) under finite second moment conditions (cf. also Szyszkowicz 
(1991) concerning related results in D[0, 1]). The paper CsNSz (1999) extends the results of 
Szyszkowicz (1991, 1992, 1996, 1997) to arbitrary positive weight functions q on (0, 00] for 
which limfj^o.tTO \'^(t)\/l(t) = Oa.s., or lim sup^io.tto I^(^)I/Q'(^) < 00 a. s. For further results 
on weighted approximations for empirical, quantile and standardized partial sum processes 
with applications to change-point analysis, we refer to two books of Csorgo and Horvath 
(1993, 1997). 

2 Proofs of the main results 

We first list several lemmas of independent interest that will be used in the proofs of the 
main results of Section 1. The first result is due to Sakhanenko (1980, 1984, 1985). 

Lemma 1 Let Xi,X2, ... be independent random variables with EXj = and cr'j = EXj < 
00 for each j > 1. Then we can redefine {Xj,j > 1} on a richer probability space together 
with a sequence of independent N{0, 1) random variables, Yj, j > 1, such that for every p > 2 
and X > 0, 



P[ max I E ^. - E ^^^ >^]< {Apfx-^' E E\X, 



"-J I 1 



where A is an absolute positive constant. 

The next two lemmas are due to CsCsHM (1986) [cf. Lemma A. 5.1 and Theorem A. 5.1 
respectively in Csorgo and Horvath (1997)]. Proofs of Lemmas 2 and 3 can also be found in 
Section 4.1 of Csorgo and Horvath (1993). For related further results along these lines we 
refer to Csorgo, Shao and Szyszkowicz (1991) and, for some historical references, to Section 
2 of CsNSz (1999) (see the statements (2.5), (2.9) and their discussion in there). 

Lemma 2 Let q E Q. If I{q, c) < oo for some c> 0, then limf^o t^^"^ /lit) = 0. 

Lemma 3 Let {14^(t), < t < oo} be a standard Wiener process and q E Q. Then, 

(a) I{q,c) < oo for all c> if and only z/limsup^^g \W{t)\/q{t) = 0, a.s. 

(b) I{q,c) < oo for some c> if and only z/limsup^^Q \W(t)\/q(t) < oo, a.s. 

We are now ready to prove the main results of Section 1. 

Proof of Theorem 1. In addition to the notation in Section 1, write 

n 

^j = ^jh\Xj\<rij) and S'* = ^X*. 

i=i 

By Lemma 1, we can redefine {Xj,j > 1} on a richer probability space together with a 

sequence of independent A^(0, 1) random variables, Yj, j > 1, such that for any a; > and 

any constant sequence Cj,j > 1, 

P{max\J2cj{x*-EX*)-J2c,a*Y,\>x} < Ax-'J2\^j\'E\Xfkx\<v.h (16) 
where a*^ = Var{X*). Let {W(t),0 < t < oo} be a standard Wiener process such that 

n 

W{n) = J2Y„ n = 1,2,3,... 
i=i 

The results (4)- (6) will be shown to hold true for the this way constructed Wiener process, 

and then Theorem 1 follows accordingly. To prove (4)- (6), we need the following proposition. 

Proposition 1 We have, as n ^ oo, 

1 "■ n* 9 

[nt] 

6;;^ sup Sintj-J^^j'^j = op{l), (18) 

0<t<l j^i 

[nt] 

b-'snp Sy^,^-Y.a*YJt''^ = Op(l). (19) 



0<t<l 






The proof of Proposition 1 will be given in Section 4. By virtue of Proposition 1, we 
have that if /(g, c) < oo for some c > 0, then 

[nt] 

In := h-^ sup Synt]-Y.^]Yi h^t) = Op{l)- (20) 

l/n<t<l j=i 

Indeed it follows from (18) and (19) that, for any < 5 < 1, 

[nt] 

/„ < sup t^'^/q{t)h-^ sn^ S^nt]-Y.<Yj h^'^ 

l/n<t<5 0<t<l j^i ' 

[nt] 

+ sup q'^{t) h;^^ sup 5'[„i] - ^o-*Fj 

<5<t<l 5<t<l j^i 

= Op{l) sup ti/Vg(t) + op(l) sup g-i(t). 

l/n<t<<5 (5<t<l 

The claim (20) now follows from Lemma 2 and the fact that inf5<(<i q{t) > for any 6 > 0. 
We now proceed to prove (4)- (6). Consider (4) and (5) first. We have 



sup 

l/n<t<l 
'1/2 



S[nt]/bn-W{nt)/y^\/q{t) < /„ + /i(n) + /2(n), 



(21) 



where Ii{n) = n ' supi/„<j<i W^([nt]) — W{nt) q{i) and 

[nt] 

h{n)= sup 6;i5:a;r,-n-i/2W^(K])/g(t). 

l/n<t<l j=i 

Note that | ^("*)^(M) ^ < t < l} =rf {w^(^^), < t < l} and ^^^ < 1 for 1/n < 



/nt '" -- — -J u, y ■ \ nt 

t <1. Similarly to the proof of (20), it follows that 
/i(n) < sup t^'^/q{t) sup 

l/n<t<S l/n<t<5 



W{[nt]) - W{nt) 



+n"^/^ sup g"^(t) sup W {[nt]) - W {nt) 

(5<t<l 5<t<l 



Op{l] 



(22) 



whenever /(g, c) < oo for some c > 0. As to l2{n), we have 

[«t] 
/2(n) < sup b-^J2^*iYj-n-^/^W{[nt]) /q{t)+ I I{n) sup q-\t), (23) 

l/n<t<5 j=i ' <5<t<l 

for any 5 E (0,1), where II{n) = maxi<fc<n b~^Y.'j=iCi'jYj — n"^^"^ Y.'j=iYj . Furthermore, 
II{n) = op{l), since it follows from (17) that, as n ^ oo. 



E[n{n)? < -E max 1^ 



n l<k<n\ f^^\l^/^{r]n) 



C: 



-IK 



''<-t{- 



O"'- 



nfr{ ^l^/'^{rin) 



- 1 



0. 



In view of (20)-(23), the results (4) and (5) will follow if we prove 

[nt] 



r(l) 



ir{n,6) :- 



sup h-' Y. ^;^. - n~'/'W{[nt]) q{t) 

l/n<t<5 j^i ' 

j op(l) if J(g, c) < oo for all c > 0, 
I Op(l) if J(g, c) < oo for some c > 0, 



(24) 



by letting n ^ oo first and then 5 | 0. In order to prove (24), let 5 > be small enough, 
so that q{t) is already nondecreasing on (0, 6) and let n be such that 1/n < 6. Since 
a* < (EX^Inxi<„AY^^ < l'^\Vn),l < J < n, we have i ^fJi (^ttStt - l)' < t, for 



'J - V"" H\x\<vj)) 
t G [0, 1]. On the other hand, for each n > 1, 



[nt] * 

^-1/2 ^r ^' 



Now it is readily seen that 

V 



[nt] 



i)y-.o<<<ip^pn^g(j^^-i)).o<<<if. 



4^^ (n, (5) = sup 

l/n<t<5 



1 ["*] a-* 



nfr{^l^^^{r]n) 



'q{t) 



< sup 

l/n<t<5 



nt] 



/I ' ' / 



0-: 



n^ ^/^/2(?7„) 



["*] 



^(n^i/T 



o",- 



,tl WV2(r^„) 



< sup W{t)\/q{t). 
0<t<S 



(25) 



This, together with Lemma 3, implies (24). The proofs of (4) and (5) is now complete. 

We next prove (6). Similarly to the proofs of (4) and (5), it suffices to show that there 
exists a sequence of positive constants r„ -^ such that if I{q, c) < oo for some c > 0, then 



sup 
-n<t<s 



[nt] 

K' E ^;^. - n-'/'W{[nt])\/q{t) = Op(l) 



(26) 



when n ^ oo first and then 5 | 0. In fact, in view of (17), there exists a sequence of positive 
constants k„ ^ oo so that 



f^n 

n 



O",- 



,§ ^I'/'iVn 



1 



0, as n ^ oo. 



This implies that for any e > 0, 

nt fri^iy^ivn) 



1>^^T^(/T 



(t: 



n 



U^mvn) 



1 <e^ 



10 



whenever !//€„ < t < 1 and n is large enough. Let r„ = !//€„ and 5 be small enough so that 
q{t) is nondecreasing on (0,(5). Then r„ ^ and, similarly to the proof of (25), we have 
that if /(g, c) < oo for some c > 0, then 



sup 

-u<t<<5 



--d sup 

T„<i<<5 



=d sup 

Tn<t<5 



n 



[nt] 



O".- 



{^l"\Vn) 



l]Y, 



[nt] 



^^E 



0"'- 



n^ Wi/2(^^) 



'^(t) 



'g(t) 



eW^(„,2Ej=i (zi/2(V) 1) ) ^(^2 ^J=l («V2(V) ^ 



yVne^ ^■5'=^ V'^72(; 



(rin.) 



lit) 



< t sup W{t)\/q{t) = eOp{l). 
0<t<5 



(27) 



This yields (26) and hence the proof of (6). The proof of Theorem 1 is now complete. 

Proof of Corollary 1. We only show part (c) following from part (a). Clearly, (c) 
implies (b), and that, in turn, (a). In fact, under the conditions that X G DAN and EX = 0, 
it follows from Theorem 1 and Lemma 3 that 



sup 

0<t<l 



S[nt]/bn-W{nt)/y^ /q{t) 



< sup 

0<t<l/n 
= Op(l), 



n~'^^W{nt) /q{t) + sup S^/^n - W{nt)/^ / q{t) 

l/n<t<l ' 



iil{q, c) < oo for any c > 0. This shows sufficiency of part (c). Noting that supg<j<]^ S[nt]/Vn— 
W{nt)/y/n q{t) > suPq<j<]^/„ n^^'^W{nt) /q{t), the necessity of part (c) follow as in Szyszkow- 
icz (1996) (pages 331-332). Hence we omit these details. The proof of Corollary 1 is now 
complete. 

Proof of Corollary 2. If one of (10) and (11) holds, then 



sup 

0<t<l 



W{t)/q{t) 



< oo a.s., 



(28) 



for any standard Wiener process. Consequently, Lemma 3 implies that I{q, c) < oo for some 
c> 0. 

Next we assume I{q,c) < oo for some c > 0. By Lemma 3 again, we get (28). Then, 
clearly as n ^ oo, we have that 

sup \W{t)\/qit)^, sup \Wit)\/q{t), 

T„<t<l 0<t<l 
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which, together with part (c) of Theorem 1, imphes (10). 
We next prove (11). Recalhng (20), we have 



K^ sup 

0<t<l 



Si 



nt] 



[nt] 

'q{t) < sup 6;i^a*r, /g(t)+Op(l). 

l/n<t<l j^i ' 



(29) 



Since o"*^ < EX'^I[\x\<rij) = KVj)^ it can be easily seen that h^'^YljJi^^f' < t for t G (0, 1]. 
This, together with the fact that q{t) is nondecreasing on (0, 1], yields that 



sup 

l/n<t<l '^i 



[nt] 



K^J2^j^J /li^) =d sup 



[nt] 

l/n<t<l j—i 

[nt] [nt] 

< sup \w{h-'Y.<)\h{K'i:< 

l/n<t<l j—i J— j^ 



< sup 

0<t<l 



W{t)\/q{t). 



(30) 



It follows from (29) and (30) that for any a; > 



lim P b„ sup 



Si 



nt] 



q{t) <x\>P\ sup W{t)\/q{t) <x\. 
/ \o<«i / 



On the other hand, (10) and the fact that r„ > obviously imply that for any x > 



lim P 6./ sup 



s 



nt] 



q{t) < x\ < lim P 6„ sup 



s 



nt] 



q{t) < X 



= P sup W{t)\/q{t) <x] . 
\o<t<i / 

Therefore, we get the desired (11). This also completes the proof of Corollary 2. 

Proof of (7). Let us consider i.i.d. symmetric random variables X, Xi,X2, ... satisfying 

EX^I(^\x[<x) = 0, for X < 1, and 

l{x) = EX'^I(^\x[<x) ~ exp ((logx)") , for X > 1, 



(31) 



where < a < 1. Then l{x) is a slowly varying function at oo. Hence, EX = and X is 
in the domain of attraction of the normal law. Along the proof, and using the notations, of 
Theorem 1, a standard Wiener process {W(t), <t < oo} can be constructed such that (6) 
holds and 



sup 

l/n<t<l 



S[nt]/bn - W{nt)l^ /q{t) 
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> 



l/n<t<l 



sup 



[nt\ 



> sup h-^ Y. "^^^J - n'^^^W{nt) q{t) - I{n) 



i=i 



[nt] 



l/n<t<l/v^ j=l 



^;'E^;^.-^"'^M^^)M)-/ 



n 



[nt] 



> sup n-^/2W^(nt) /g(t) - sup 6;^ ^CT*rWg(t) - /(n), 

l/n<t<l/v^ l/n<t<l/v^ j=l 

where I{n) is defined as in (20). Noting that q^{t) = tloglog(t"^) satisfies I{q,2) < oo, 
/(n) = op(l). So, to show (7), it suffices to show that 



sup 

l/n<t<l/v^ 



n'^/^W{nt) /q{t)=d sup 

l/n<t<l/v^ 



W-(t) /g(t) ^ op(l) 



(32) 



with g^(t) = tloglog(t ^), and if /(g, c) < oo for some c > 0, then 



sup 

l/n<t<l/v^ 






(33) 



We first prove (33). For the l{x) defined in (31), it can be easily shown that, for n large 
enough, r]n > ^Jn and maxi<j<^r7j < (v^) • Hence, 



max /(r7j)//(r7„) <2exp (0.3° - 0.5") (logn 



i<i<V" 



0, as n — !► oo. 



This, together with a* < /(r^j), yields that, as n ^ oo. 



[nt] 



\nt\ 



1 L'"-J 1 l'"-J /('„ ^ 

__ y^ rr*2 < __ \^ H 7J y 

thl fr{ ' - nt fr{ Kvn] 



0, 



whenever 1/n < t < ^/n. Now, a method that is similar to making statements as in (27) 
shows that 



sup 

l/n<t<l/^ 



[nt] [nt] 

K' E ^]yj\/m=d sup \w{b;;' E ^f ) |/?(^) = «p(i), 



which implies (33). 

Next we prove (32). In fact, if (32) is not true, i.e., if 



sup 

l/n<t<l/0i 



W{t) /q{t)=Op{l), 
then there exists an < e < 1/4 such that 

P I sup W{t) /q{t) < 6^/2/2 ) > 1/2. 
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Hence, following the proof of (4.1.14) in Csorgo and Horvath (1993, page 185), we have, for 
g^(t) = tloglog(t^^), as n ^ oo. 



^ P ( sup W{t) /q{t) > e^/V2 ) 

\l/n<t<l//n / 

1 /-l/v^ 1 / o \ 



1 /-l/v^ 1 



> - / -exp(-2-Moglog(t-^))cit 

4 Jl/n t ^ ^ 



— o(l ^) (logn 



a/2 



oo. 



2V- 72^ 

This is a contradiction, which implies that (32) holds. The proof of (7) is now complete. 
Proof of Theorem 2. It follows from (5) that if I{q, c) < oo for some c > 0, then 

b-' sup \Si^t]\/q{t) < sup n''/'\W{nt)\/q{t) 

l/n<t<l ' l/n<t<l ' 



+ sup 

l/n<t<l 



Sint]lhn - W{nt)/^ /q{t) = Op{l). 



This, together with (12), yields that 



sup 

l/n<t<l 



S[nt]/Vn — S[nt]/bn / q(t) < 



K. 



K^ sup \S[nt]\/q{t) =Op{l) 
l/n<t<l 



(34) 



whenever I{q, c) < oo for some c > 0. Theorem 2 now follows immediately from (34) and 
Theorem 1. 

Proofs of Corollaries 3-5. In view of Theorem 2, the proofs of Corollaries 3-5 are the 
same as in the proofs of Corollaries 1 and 2 and hence the details are omitted. 

3 Proof of Proposition 1 

We only prove (19). The result (17) can be found in CsSzW (2003, page 1235) and the result 
(18) follows from similar arguments. Let 

Z, = X* - EX* - a^Y,, J = 1,2,..., 

and write tjq = 0. Note that ?7| < (j + l)/(^j) and /(?]„) = Z]fe=i E^'^hrik-i<\x\<r]k)- ^^ follows 
from the Shorack and Smythe inequality (cf. Shorack and Weller, 1986, p. 844), (16) with 
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l/ji/2 that, for any C > 0, 



[nt] 



P\ sup \J2ZA/t^/^>CK 

l/n<t<l ' j=i ' 



< P I max 

1<A;<?1 



k 

< P[ max |^j~^/^^j >2-^Cbn/y/n 



l<k<n I 



i=i 



n 



A:=l 

n 



fc=l 

< AC-^ 



This yields 



[nt] 



Jl 



In 



6;i sup E^.A'^' = Op(i). 

l/n<t<l ' j=i ' 



(35) 



Similarly, by noting that /(?]„) = ELi ^^^A%-i<|x|<r,fe) and E|X|J(|x|>,,„) = o{r]Jl{r]n)) = 
o(hn/n) [see Lemma 1 of CsSzW (2003) for example], it follows from (7) in CsSzW (2003) 
with ttj = EX^I(^r,j_i<\x\<r,j) that 

/ [nt] N 

P{ sup \Y,iX^-X* + EX*) t'/'>Cbn 

\ l/n<t<l ' j=i 

2n^/^ " 1 

< ^— EtI7^^I-^IA|^I>%) 



< ^"^ F\X\T I 2g-^ f 1 p|^|. 

o/^— 1 n 



<l^l<'?n) 



^^/^(^n) ,tt 



< AC-\ 
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This yields 



[nt] 

hn ■■= b-' sup \J2{X,-X* + EX*) /t'/^ = Op{l). 

l/n<t<l ' j=i 



(36) 



Combining the estimates (35) and (36), we obtain 

[nt] 



0<t<l 



i=i 



b-' sup Sl^t] - E ^;^.- A'^' < Jm + J2n = Op{l) 



which imphes (19). This also completes the proof of Proposition 1. 

4 Lp-approximations of weighted self-normalized pro- 
cesses 

Noting that limsup^io |W^(t)|/t-'^/^ = ooa.s., it is impossible to extend Theorem 2 and its 
corollaries to the weight function q{t) = t^'^. However, due to the finiteness of the inte- 
gral /q \W{t)\/t^^'^dt, such a weight function is an immediate candidate for weighted Li- 
approximation. We still use Q to denote the class of those positive functions on (0, 1] for 
which q{t) is nondecreasing near zero. The main purpose of this section is to establish 
Lp-approximations of weighted self-normalized partial sum processes, and thus to extend 
Theorem 1.1 of Szyszkowicz (1993) that is based on assuming two moments when working 
with standardized partial sums. 

Theorem 3 Let q E Q and < p < oo. Let EX = and X be in the domain of attraction 
of the normal law. Then the following statements hold true. 

(a) On an appropriate probability space for the i.i.d. random variables X,Xi,X2, ..., we 
can construct a standard Wiener process {W{t),0 < t < oo} such that, as n ^ oo, 

I' \v-'Sint] - n-'/'W{nt)\yq{t)dt = op(l) (37) 

if and only if 



t^'^/q{t)dt < 



oo. 



(3J 



(b) Let {W{t), < t < oo} be a .standard Wiener process. Then, as n -^ oo, 



V„ S\ 



[nt] 



'q{t)dt 



W{t) q{t)dt 



if and only if (38) holds. 



(39) 
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It is of interest to call attention to the fact that (a) and (b) are equivalent under the 
conditions of Theorem 3. Thus, unlike in the case of Theorem 2 where, in addition to 
Corollary 3 we also have Corollary 4 for a larger class of weight functions, in Lp we have (a) 
and (b) for the same class of weight functions. 

In the proof of Theorem 3 we make use of the following result, which is a consequence of 
Corollary 2.1 of Csorgo, Horvath and Shao (1993). 

Lemma 4 Let {W{t)^Q < t < oo} be a standard Wiener process, < p < oo, and assume 
that q is a positive function on (0, 1]. Then (38) holds if and only if 

\W{t)\yq{t)dt<oo a.s. (40) 

0+ 

We now turn to the proof of Theorem 3. 

Proof. We first show (a). If (37) is satisfied, then 

l/n „ , /"l/" n I 

n-^/^W{nt) yq{t)dt=d / W{t) j q{t)dt = Op(l). 

Therefore, following the proof of Theorem 1.1 of Szyszkowicz (1993), we have (40), and hence 
also (38), via Lemma 4. 

We now prove that (38) implies (37). Still using the notations in the proof of Theorem 
1, it can be easily seen that for 6 E (0, 1), 
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V^'S^nt]-n'^'^W{nt)'' /q{t)dt 



< 



V-^S^nt]-n-^'^W{nt)\' /q{t)dt 



Vn J Jl/n 



+ [y^j ljK'T.^*yj\/qit)dt + J^ \n-'/'W{nt)\yq{t)dt 



:= Ih{n) + Ihin) + Ihin) + Ihin) + Ih{n). 
By Theorem 2, we have 



(41) 



Ih{n) < sup V-^Syat]-n-^''^W{nt)'' I / q{t)dt 

0<t<l -IS ' 

= Op(l), for any 6 G (0,1). 
By (12) and (36), it follows that 

Ihin) < ('M'(J2„)^£^t^/Yg(t)rft = Op(l)^%^/7g(t)rft. 

Similarly, by (12) and (35), we get 

Ihin) < (^\\jva)'' [^/''/qit)dt = Opil) j\^''/qit)dt. 



(42) 



(43) 



(44) 



Let 5 be small enough so that q is already nondecreasing on (0, 5). Similarly to the proof of 
(30), we have 



l/n 



M n-*2 






nt] *2 

^ 'dt. 



This, together with (12), implies that 



Ihin) = Op(l) 






nt] *2 



a: 



j^ [nt] ^*2 



^bE 



/(r^n)-^ / ^nf^-^lir]n) 



dt. 



(45) 



We also have for each n 

Ih{n) =, f^\w{t)\^/q{t)dt. (46) 

Taking n ^ oo and then 5 arbitrarily small, on using (38) via Lemma 4, by (41)-(46) we 
arrive at (37). 

We next show (b). If (39) holds true, then clearly we have (40) and hence also (38) by 
Lemma 4. Conversely, we now assume (38). Since g is a positive function on (0, 1], it follows 
from Theorem 2 that, as n -^ oo, 

[ \v-'S^nt^\'/q{t)dt ^, f^ \w{t)\'/q{t)dt 

for all 5 G (0, 1). On using (38), by Lemma 4 we conclude that 

Vr(t)|Yg(t)rft = a.s. 



lim / 

<5iO Jo 



From here on, mutatis mutandis, the proof follows similarly to that of proving (iii) of Theorem 
1.1 of Csorgo, Horvath and Shao (1993). 
This completes the proof of Theorem 3. 

REFERENCES 

Anderson, T. W. and Darling, D. A. (1952). Asymptotic theory of certain "goodness of fit" 
criteria based on stochastic processes, Ann. Math. Statist. 23, 193-212. 

Breiman, L. (1968). Probability, Addison-Wesley, Reading, MA. 

Chibisov, D. (1964). Some theorems on the limiting behaviour of empirical distribution 
functions. Selected Transl. Math. Statist. Probab. 6, 147-156. 

Chistyakov, G. P. and Gotze, F. (2004). Limit distributions of Studentized means. Ann. 
Probab. 32, no. lA, 28-77. 

Csorgo, M. (2002). A glimpse of the impact of Pal Erdos on probability and statistics. The 
Canadian Journal of Statistics 30, 493-556. 

Csorgo, M., Csorgo, S., Horvath, L. and Mason, D.M. (1986). Weighted empirical and 
quantile processes, Ann. Probab. 14, 31-85. 

Csorgo, M. and Horvath, L. (1986). Approximations of weighted empirical and quantile 
processes. Statist. Probab. Lett. 4, 151-154. 

Csorgo, M. and Horvath, L. (1988). Nonparametric methods for changepoint problems. 
In Handbook of Statistics, 7, Elsevier Science Publisher B.V., 403-425, North- Holland, 
Amsterdam. 

Csorgo, M. and Horvath, L. (1993). Weighted Approximations in Probability and Statistics, 
Wiley Series in Probability and Mathematical Statistics: Probability and Mathematical 
Statistics, Wiley, Chichester. 

19 



Csorgo, M. and Horvath, L. (1997). Limit Theorems in Change-Point Analysis, Wiley Series 
in Probability and Mathematical Statistics: Probability and Mathematical Statistics, 
Wiley, Chichester. 

Csorgo, M. and Horvath, L. and Shao, Q.-M. (1993). Convergence of integrals of uniform 
empirical and quantile processes. Stochastic Process. Appl. 45, 283-294. 

Csorgo, M., Norvaisa, R. and Szyszkowicz, B. (1999). Convergence of weighted partial sums 
when the limiting distribution is not necessarily Radon, Stochastic Process. Appl. 81, 
81-101. 

Csorgo, M. and Revesz, P. (1981). Strong Approximations in Probability and Statistics, 
Academic Press, New York. 

Csorgo, M., Shao, Q.-M. and Szyszkowicz, B. (1991). A note on local and global functions 
of a Wiener process and some Renyi-type statistics, Studia Sci. Math. Hungar. 26, 
239-259. 

Cs5rg6, M., Szyszkowicz, B. and Wang, Q. (2003). Donsker's theorem for self-normalized 
partial sums processes. Ann. Probab. 31, 1228-1240. 

Csorgo, M., Szyszkowicz, B. and Wang, Q. (2004). On weighted approximations and strong 
limit theorems for self- normalized partial sums processes. In Asymptotic Methods in 
Stochastics, 489-521, Fields Inst. Commun. 44, Amer. Math. Soc, Providence, RI. 

Cine, E., Gotze, F. and Mason, D.M. (1997). When is the Student t-statistic asymptotically 
standard normal? Ann. Probab. 25, 1514-1531. 

Griffin, P.S. (2002). Tightness of the Student t-statistic. Electron. Comm. Probab. 2, 
181-190. 

Komlos, J., Major, P. and Tusnady, G. (1975). An approximation of partial sums of inde- 
pendent RV's, and the sample DF, I., Z. Wahrscheinlichkeitstheorie verw. Gebiete 32, 
111-131. 

Komlos, J., Major, P. and Tusnady, G. (1976). An approximation of partial sums of inde- 
pendent RV's, and the sample DF. II., Z. Wahrscheinlichkeitstheorie verw. Gebiete 34, 
33-58. 

Logan, B.F., Mallows, C.L., Rice, S.O. and Shepp, L.A. (1973), Limit distributions of 
self- normalized sums. Ann. Probab. 1, 788-809. 

O'Reilly, P. (1974). On the weak convergence of empirical processes in sup-norm metric, 
Ann. Probab. 2, 642-651. 

Major, P.(1976). The approximation of partial sums of independent RV's. Z. Wahrschein- 
lichkeitstheorie und Verw. Gebiete 35, 213-220. 

Pyke, R. and Shorack, G.R. (1968). Weak convergence of two-sample empirical processes 
and a new approach to Chernoff- Savage theorems, Ann. Math. Statist. 39, 755-771. 

Renyi, A. (1953). On the theory of order statistics. Acta. Math. Acad. Sci. Hungar. 4, 
191-231. 

Sakhanenko, A. I. (1980). On unimprovable estimates of the rate of convergence in invariance 
principle. In Colloquia Math. Soc. Jdnos Bolyai 32, N onparametric Statistical Inference, 
Budapest, Hungary, 779-783, North- Holland, Amsterdam. 

20 



Sakhanenko, A. I. (1984). On estimates of the rate of convergence in the invariance princi- 
ple, In Advances in Probability Theory: Limit Theorems and Related Problems, (A. A. 
Borovkov, Ed.) 124-135. Springer, New York. 

Sakhanenko, A. I. (1985). Convergence rate in the invariance principle for non-identically 
distributed variables with exponential moments. In Advances in Probability Theory: 
Limit Theorems for Sums of Random Variables, (A. A. Borovkov, Ed.) 2-73. Springer, 
New York. 

Shorack, G. R. and Wellner, J. A. (1986). Empirical Processes with Applications to Statistics, 
Wiley Series in Probability and Mathematical Statistics: Probability and Mathematical 
Statistics, Wiley, New York. 

"Student" (1908). The probable error of the mean, Biometrika 6, 1-25. 

Szyszkowicz, B. (1991). Weighted stochastic processes under contiguous alternatives, C.R. 
Math. Rep. Acad. Sci. Canada 13, 211-216. 

Szyszkowicz, B. (1992). Weighted asymptotics of partial sum processes in D[0,oo), C.R. 
Math. Rep. Acad. Set. Canada 14, 273-278. 

Szyszkowicz, B. (1993). Lp-approximations of weighted partial sum processes. Stochastic 
Process. Appl. 45, 295-308. 

Szyszkowicz, B. (1996). Weighted approximations of partial sum processes in D[0, oo). I, 
Studia Sci. Math. Hungar. 31, 323-353. 

Szyszkowicz, B. (1997). Weighted approximations of partial sum processes in D[0,oo). II, 
Studia Sci. Math. Hungar. 33, 305-320. 



Miklos Csorgo 

School of Mathematics and Statistics 

Carleton University 

1125 Colonel By Drive 

Ottawa, ON Canada KIS 5B6 

mcsorgoSmath . carleton . ca 

Barbara Szyszkowicz 

School of Mathematics and Statistics 

Carleton University 

1125 Colonel By Drive 

Ottawa, ON Canada KIS 5B6 

bszyszkoOmath . carleton . ca 

Q lying Wang 

School of Mathematics and Statistics 

University of Sydney 

NSW 2006, Australia 

qiyingOmaths . usyd . edu . au 



21 



